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MORE THAN BARGAINED FOR IN REVERSE MATHEMATICS 


SAM SANDERS 


Abstract. Reverse Mathematics (RM for short) is a program in the founda¬ 
tions of mathematics with the aim of finding the minimal axioms required 
for proving theorems about countable and separable objects. RM usually 
takes place in second-order arithmetic and due to this choice of framework, 
continuous real-valued functions have to be represented by so-called codes. 
Kohlenbach has shown that the RM-definition of continuity-via-codes consti¬ 
tutes a slight constructive enrichment of the epsilon-delta definition, namely 
in the form of a modulus of continuity. In this paper, we show that the RM- 
definition of continuity also gives rise to a ‘nonstandard’ enrichment in the form 
of nonstandard continuity from Nonstandard Analysis. This observation al¬ 
lows us to (i) establish that RM-theorems related to continuity are implicitly 
higher-order statements, (ii) prove equivalences between RM-theorems con¬ 
cerning continuity and their associated higher-order versions, and (iii) obtain 
explicit equivalences between higher-order theorems from the equivalence be¬ 
tween the corresponding RM-theorems. Moreover, we show that it is exactly 
the RM-definition of continuity-via-codes which gives rise to these higher-order 
phenomena. In conclusion, we establish that the practice of coding in RM, de¬ 
signed to obviate higher-type objects, actually introduces a host of new ones. 


1. Introduction 

In two words, the topic of this paper is the implicit presence of higher-order 
statements in second-order Friedman-Simpson Reverse Mathematics. In particular, 
we show that the definition of continuity-via-codes used in the latter, gives rise to 
higher-order statements. We first introduce the aforementioned italicised notions. 

Reverse Mathematics (RM for short) is a program in the foundations of math¬ 
ematics initiated by Friedman (TO, and developed extensively by Simpson and 
others (See [18l[T9] for an overview and introduction). The aim of RM is to find the 
axioms necessary to prove a given theorem of ordinary, i.e. about countable and 
separable objects, mathematics, assuming the ‘base theory’ RCAo, a weak system of 
computable mathematics. RM usually takes place in second-order arithmetic, i.e. 
a system of first-order logic with two sorts: natural numbers and sets of the latter 
(equivalently: Only type 0 and 1 objects are available). By contrast, in Kohlen- 
bach’s base theory RCAq for higher-order RM (See {8] for details), all finite types 
are available. Thus, objects of type ‘higher than 1’ shall be informally referred to 
as ‘higher-order’. 
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In RM, real numbers are represented by fast-converging Cauchy sequences as in 
[H II.4.4]; This implies that real-valued functions are not ‘directly’ available in 
RM (as they have type 1 —> 1). To this end, continuous functions are represented 
by (type 1) codes as in JT9J II.6.1]. In {9, §4], Kohlenbacli proves that this RM- 
definition of continuity involves a slight constructive enrichment of the usual epsilon- 
delta definition of continuity, namely in the form of a modulus of continuity. This 
constructive enrichment should be compared to Simpson’s claim to the contrary in 
Hi 1.8.9 and IV2.8], 

In Section 18.11 we show that the RM-definition of continuity gives rise to a 
‘nonstandard’ enrichment, namely that standard RM-continuous functions are non¬ 
standard continuous, and vice versa, inside a weak system of Nonstandard Analysis 
based on RCAq . In Section 13.21 we explore how this observation gives rise to 
a higher-order statement, namely the existence of a modulus-of-continuity func¬ 
tional, implicit in the base theory RCAq. Similar higher-order statements are im¬ 
plicit in other RM-theorems (not necessarily concerning continuity), as explored in 
Remark 13.61 

Now, some readers would perhaps be more easily convinced of the veracity of 
our claim (that higher-order statements are implicit in second-order RM) if no 
nonstandard methods were used. Hence, in Section [H we prove that the statement 

Every RM -continuous function on Cantor space is uniformly RM -continuous. 
is equivalent, in Kohlenbach’s higher order RM, to the statement that 

There is a type three functional which witnesses the uniform RM -continuity of 
every KM-continuous functional on Cantor space. 

This equivalence does not involve (but is inspired by) Nonstandard Analysis. We 
also show that the previous equivalence only goes through because of the use of 
RM-continuity, as the latter has greatly reduced quantifier complexity compared to 
the usual definition of continuity. Similar equivalences hold for other RM-theorems 
related to continuity. We should also point out that while the RM-definition of 
continuity represents continuous type 2 and 1 —»• 1 functions by type 1 objects, the 
previous equivalence involves type 3 objects (See Theorems 14. II and 15.211 . 

In Section [5l we push our claim (that higher-order statements are implicit 
in second-order RM) one step further by deriving explicit equivalences between 
higher-order principles from equivalences in second-order RM. Surprisingly, these 
explicit equivalences are derived using results in Nonstandard Analysis from ( 21 . In 
particular, the results in Section [5] hint at a hitherto unknown computational aspect 
of Nonstandard Analysis, studied further in mm- 

In conclusion, the results in this paper suggest that insisting on formalising 
mathematics in second-order arithmetic is self-defeating: The RM-definition of con¬ 
tinuity brings in higher types ‘through the back door’. Note that we do not claim 
that such a formalisation is pointless: We merely point out that the reduction in 
ontological commitment (provided by the use of second-order arithmetic in RM) 
should not be exaggerated, especially since the coding practice of RM gives rise to 
type 3 objects, as shown in Theorems 14. II and 15.21 

1 An implication (3<I>)A(<t>) —> (3T ; ) B( X V) is explicit if there is a term t in the language such 
that additionally (V<i>)[A(<I>) —> B(t(<t>))], i.e. it can be explicitly defined in terms of ■!>. 
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2. About and around the base theory RCAq 

In this section, we introduce the base theory RCAq in which we will work. In 
two words, RCAq is a conservative extension of Kohlenbach’s base theory RCAq 
from [8] with certain axioms from Nelson’s Internal Set Theory (|1~0] 1 based on the 
approach from Eli- The system RCAq is in turn a conservative extension of RCAo 
for the second-order language by ]8j Prop. 3.1]. 

2.1. Internal set theory and its fragments. In this section, we discuss Nelson’s 
internal set theory , first introduced in [101 , and its fragments from [2]. 

In Nelson’s syntactic approach to Nonstandard Analysis am as opposed to 
Robinson’s semantic one am a new predicate ‘st(x)’, read as l x is standard’ is 
added to the language of ZFC, the usual foundation of mathematics. The notations 
(V st a;) and (3 st y) are short for (Vx)(st(x) —»■...) and (3j/)(st(y) A...). A formula is 
called internal if it does not involve ‘st’, and external otherwise. The three external 
axioms Idealisation, Standard Part, and Transfer govern the new predicate ‘st’; 
They are respectively defmecQ as: 

(I) (V st fin a;)(3?/)(Vz £ x)ip(z,y) —» (3y)(V st x)tp(x,y), for internal <p with any 
(possibly nonstandard) parameters. 

(S) (Vx)(3 st y)(V st z)(z £ x -n- z £ y). 

(T) (V st x)<p{x,t) —> (\/x)ip(x,t), where ip is internal, t captures all parameters 
of ip, and t is standard. 

The system 1ST is (the internal system) ZFC extended with the aforementioned 
external axioms; The former is a conservative extension of ZFC for the internal 
language, as proved in ma¬ 
in E], the authors study Godel’s system T extended with special cases of the 
external axioms of 1ST. In particular, they consider nonstandard extensions of the 
(internal) systems E-HA^ and E-PA W , respectively Heyting and Peano arithmetic 
in all finite types and the axiom of extensionality. We refer to El §2-1] for the 
exact details of these (mainstream in mathematical logic) systems. We do mention 
that in these systems of higher-order arithmetic, each variable x p comes equipped 
with a superscript denoting its type, which is however often implicit. As to the 
coding of multiple variables, the type p* is the type of finite sequences of type p, 
a notational device used in [2] and this paper; Underlined variables x consist of 
multiple variables of (possibly) different type. 

In the next section, we introduce the systems RCAq assuming familiarity with 
the higher-type framework of Godel’s T (See e.g. El §2.1]). 

2.2. The base theory RCAq . In this section, we introduce the system RCAq . We 
first discuss some of the external axioms studied in [2]. First of all, Nelson’s axiom 
Standard part is weakened to HACj nt as follows: 

(WVXdVMuy) (3 st F^*)(V st ^)(3^ £ F(x))ip(x, y), (HAC int ) 

where tp is any internal formula. Note that F only provides a finite sequence of 
witnesses to (3 st y), explaining its name Herbrandized Axiom of Choice. Secondly, 


2 The superscript ‘fin’ in (I) means that x is finite, i.e. its number of elements are bounded by 
a natural number. 
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Nelson’s axiom idealisation I appears in [2] as follows: 

(V st aO(3 yT)Wz? G x)<p(z,y) -A (3 \y T )(V st x°)<p(x,y), (I) 

where <p is again an internal formula. Finally, as in [2j Def. 6.1], we have the 
following definition. 

Definition 2.1. The set T* is defined as the collection of all the constants in the 
language of E-PA“*. The system E-PA“ t * is defined as E-PA“* + T s l + IA st , where 
7g£ consists of the following axiom schemas. 

(1) The schemfd st(x) A x = y —> st (y), 

(2) The schema providing for each closed term t G T* the axiom st(t). 

(3) The schema st(/) A st(x) —> st(/(x)). 

The external induction axiom IA st is as follows. 

$(0) A (V st n°)($(n) -»■ $(n + 1)) -)• (V st n°)4>(n). (IA st ) 

For the full system P = E-PA“ t * + HACi nt + l + IA st , we have the following theorem. 
The superscript ‘S s 1 ’ in the theorem is the syntactic translation defined as follows. 

Definition 2.2. If <b(a) and 3>(b) in the language of P have interpretations 

< F(a)‘ Sst = (V st x)(3 st y)‘fi{x,y,a) and '&(b) Sst = (V st u)(3 st v)ip(u,v,b), (2.1) 

then they interact as follows with the logical connectives by [2] Def. 7.1]: 

(i) ip Sst := ip for atomic internal ip. 

(ii) (st( 0 )) Sat := (3 st x)(2 = a;). 

(iii) (-i$) Sst := (V st y)(3 st a:)(V?/ G Y]x\)~ , ‘p{x, y, a). 

(iv) (4> V 'F) Sst := (V st x, u)(3 st y,y)[ip{x, y, a) V ip(u,v,ti)\ 

(v) ((Vz)$) Sst := (\/ st x)(3 st y)fdz)(3y^ G y)ip(x,y^, z) 

Theorem 2.3. Let $( 0 ) be a formula in the language of E-PA]tj* and suppose 
$(a) Sst =y st x_3 st y ip(x,y,a). If Aj nt is a collection of internal formulas and 

P + A; nt F d^a), (2-2) 

then one can extract from the proof a sequence of closed terms t in T* such that 

E-PA W * + Aj nt P Vx 3y G t(x) <p{x, y, a). (2-3) 

Proof. Immediate by [2] Theorem 7.7]. □ 

The proofs of the soundness theorems in [2] §5-7] provide an algorithm A to 
obtain the term t from the theorem. The following corollary is only mentioned in 
(2] for Heyting arithmetic, but is also valid for Peano arithmetic. 

Corollary 2.4. If for internal ip the formula 4>(a) = (V st x)(3 st y)ip(x, y,a) satisfies 
(12.21) . then (Vx)(3 y G t(x))ip(x,y, a) is proved in the corresponding formula (12.31) . 

Proof. Clearly, if for ip and 4> as given we have <h(a) Sst = 4*(a), then the corollary 
follows immediately from the theorem. A tedious but straightforward verification 
using the clauses (i)-(v) in [2] Def. 7.1] establishes that indeed = 4>(a). This 

verification may be found in [T5J §2]. □ 

'-''The language of E-PA^* contains a symbol st CT for each finite type a. but the subscript is 
always omitted. Hence Tf is an axiom schema and not an axiom. 
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Finally, the previous theorems do not really depend on the presence of full Peano 
arithmetic. Indeed, let E-PRA 1 ^ be the system defined in jH §2] and let E-PRA“* 
be its definitional extension with types for finite sequences as in [5J § 2 ]. 

Corollary 2.5. The previous theorem and corollary go through for P replaced by 
RCAq = E-PRA W * + Tf t + HAC int + I + QF-AC 1,0 . 

Proof. The proof of [2J Theorem 7.7] goes through for any fragment of E-PA“* 
which includes EFA, sometimes also called IA 0 + EXP. In particular, the exponential 
function is (all what is) required to ‘easily’ manipulate finite sequences. □ 

Finally, we note that Ferreira and Gaspar present a system similar to P in [4]. 
We plan to study this system in [16] , but have no use for it in this paper. 

2.3. Notations. We finish this section with two remarks on notation. First of all, 
we shall use Nelson’s notations, as sketched now. 

Remark 2.6 (Notations). We write (V st ir T )<f , (a; T ) and (3 st a; cr )'I'(a; IT ) as short for 
(Vx T ) [st(x T ) —>• <F(a;' r )] and (3 st a:' T ) [st^ 17 ) A 'F(x cr )]. We also write (Vcc° G Pl)<I>(:r 0 ) 
and (3x° £ fl)'F(a; 0 ) as short for (Vx 0 ) [-ist(a; 0 ) —> <F(a; 0 )] and (3x°) [-ist(x°) A 
'F(a; 0 )]. Furthermore, if -ist(ir 0 ) (resp. st(x 0 )), we also say that a ; 0 is ‘infinite’ 
(resp. finite) and write ‘x° £ fl’. Finally, a formula A is ‘internal’ if it does not 
involve st, and A st is defined from A by appending ‘st’ to all quantifiers (except 
bounded number quantifiers). 

Secondly, we shall use the usual notations for rational and real numbers and 
functions as introduced in [SJ p. 288-289] (and [19] 1.8.1 and II.4.4] for the former). 

Remark 2.7 (Real number). A (standard) real number £ is a (standard) fast¬ 
converging Cauchy sequence qh, i.e. (Vn°, i°)(|g„ — q n +i)\ <o jz)- We freely use of 
Kohlenbacli’s ‘hat function’ from [5] p. 289] to guarantee that every sequence f 1 can 
be viewed as a real. Two reals x,y represented by qp) and 77 .) are equal , denoted 
x = y, if (Vn)(|q n — r n | < ^). Inequality < is defined similarly. We also write x ~ y 
if (V st n)(|g n — r n | < -^) and x y if x > yAx 56 y. Real-valued functions F : IR —>• R 
are represented by functionals such that (Wx,y)(x = y —>• $(a;) = $(y)), i.e. 

equal reals are mapped to equal reals. 

Thirdly, we use the usual extensional notion of equality. 

Remark 2.8 (Equality). The system RCAq includes equality between natural num¬ 
bers ‘= 0 ’ as a primitive. Equality ‘= T ’ for type r-objects x, y is then defined as: 

[x = T y\ = (Vzp ... z T k k )[xzi... z k =0 yzi... z k ] (2.4) 

if the type r is composed as r = (rr - 7 - ... —> r k —> 0). In the spirit of Nonstandard 
Analysis, we define ‘approximate equality ~ T ’ as follows: 

[x w T y\ = (V 8 *^ 1 ... zf k ) \xz x ...Zk=oyzi... z k \ (2.5) 

with the type r as above. All systems under consideration include the axiom of 
extensionality for all ip p ^ T as follows: 

(Vz p ,?/ p )[.t = p y ->• ip(x) = T <p(y)\. (E) 

However, as noted in [2 p. 1973], the so-called axiom of standard extensionality 
m st is problematic and cannot be included in RCAq . 
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3. Higher-order statements implicit in second-order RM 

In this section, we show that higher-order statements are implicit in second-order 
RM. We start by establishing that the RM-definition of continuity actually consti¬ 
tutes nonstandard continuity (and vice versa) in Section [3711 We subsequently show 
in Section [3.21 that this ‘nonstandard’ enrichment of continuity gives rise to (equiv¬ 
alent) higher-order statements in the form of a modulus-of-continuity functional. 

3.1. The nonstandard enrichment of continuity. In this section, we show 
that the RM-definition of continuity as in ns II.6.1] constitutes a ‘nonstandard’ 
enrichment of the usual epsilon-delta-definition of continuity. In particular, we 
show that standard functions which are continuous in the sense of RM, i.e. given 
by codes, are also nonstandard continuous. Conversely, we show that a nonstandard 
continuous type 2 functional has a code (in the standard world). 

3.1.1. Definitions and preliminaries. In this section, we introduce the required def¬ 
initions and preliminaries. First of all, the definition of continuity on Baire space 
(<J > 2 G C for short) is: 

(Vcr 1 )(3A" 0 )(V/3 1 )(aiV = 0 ~0N $(a) = 0 $(/?)). (3.1) 

We say that the functional <I > 2 is standard continuous if it satisfies (13.111 st . and that 
the functional $ 2 is nonstandard continuous if 

(V st a 1 )(V/3 1 )(a «! 0 -A $(<*) = 0 *(0)). (3.2) 

where a 0 if (V st n°)[a(n) = 0{n)\. If (13.11) holds limited to binary sequences, 
we say that $ is continuous on Cantor space , and write ‘$ G C(2 N )’ for short. 

In the next section, we show that standard functions continuous in the sense of 
RM are also nonstandard continuous as in (13.211 . In Theorem 13.21 below, we also 
show the ‘converse’, namely that every type 2 functional which is nonstandard con¬ 
tinuous as in (13.211 . has a RM-code (relative to ‘st’). By |9j Prop. 4.6], nonstandard 
continuity thus constitutes a constructive enrichment. 

Secondly, with regard to known results, Kohlenbach shows in [9, §4] that the 
RM-definition of continuity includes a constructive enrichment in the form of a 
modulus of ( pointwise ) continuity , in contrast to Simpson’s claim (See [T9] 1.8.9 and 
IV.2. 8 ]) that Reverse Mathematics analyses theorems ‘as they stand’, i.e. without 
constructive enrichments. Notwithstanding this negative result, Kohlenbach also 
shows in [9] §4] that the enrichment present in [19] II.6.1] is in general harmless. In 
particular, there is no change to the RM-equivalences of weak Konig’s lemma. 

In more detail, Friedman-Simpson style Reverse Mathematics takes place in (sub¬ 
systems of) second-order arithmetic, i.e. only type 0 and 1 (numbers and sets of 
the latter) objects are available. Simpson motivates this choice as follows: 

[the second-order] language is the weakest one that is rich enough to 
express and develop the bulk of core mathematics. ([19, Preface]) 

As a result of this choice of framework, one cannot define real-valued functions 
‘directly’ in RM, as the latter objects have type 1 —>• 1. For this reason, a real¬ 
valued continuous function is represented in Reverse Mathematics by a (type 1) 
code as in [19, II.6.1]. Kohlenbach shows in [9] Prop. 4.4] that the existence of a 
code for a continuous functional $ 2 , is equivalent to the existence of an associate 
for $ as in [9] Def. 4.3], and equivalent to the existence of a modulus of continuity 
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for <h. Since associates are more amenable to our framework, we shall therefore 
work with the former, instead of RM-codes. The definition is as follows. 

Definition 3.1. The function a 1 is an associate of a continuous functional <f > 2 if: 

(i) (yp'XBk^aQik) > 0 , 

(ii) (V/3 1 , k°)(a(fik) > 0 -> $(/3) + 1 =0 a(J3k)). 

Note that we assume that every associate is a neighbourhood function as in [9j. 
The range of /3 in the previous definition may be restricted if <h 2 is only continuous 
on a subspace. Finally, if the two items from Definition 13.11 only hold relative to 
‘st’, then we say that a 1 is an associate for <f > 2 relative to ‘st ’. 

3.1.2. Nonstandard continuity and known associates. We now show that standard 
functions continuous in the sense of RM are nonstandard continuous as in (13^1) . 
and vice versa. Our development takes place inside RCAq . For simplicity, we work 
over Baire space rather than with real numbers. 

Since the Reverse Mathematics definition of ‘continuity-via-codes’ implicitly in¬ 
volves a continuous modulus of continuity (again, by [5J Prop. 4.4]), we shall make 
the latter explicit. Hence, we represent a continuous function <f> on Baire space via 
a pair of codes (a 1 ,^ 1 ), where a codes <f> and /? codes its continuous modulus of 
pointwise continuity w#. In more technical detail, a and (3 satisfy 

{\/'y 1 )(3N°)a(*/N) > 0 A (Vy 1 )^ 0 )/?^) > 0, 

and the values of uj$ and </> at 7 1 <1 1 , denoted 7 ) and <^( 7 ), are /3(jk) — 1 
and a( 7 k) — 1 for any k° such that /3(y k) > 0 and a{pjk) > 0. With the previous 
definitions in place, the following formula makes sense and expresses that is the 
modulus of continuity of <j>: 

(VC 1 ,7 1 )(CW(C) = 7^(0 0(C) = 0(7))- (3-3) 

In short, the representation of a functional <j> on Baire space via the RM-definition 
of continuity is equivalent to our representation (13.31) . 

Now, a basic property of any standard functional is that it maps standard inputs 
to standard outputs. This ‘standardness’ property is a basic axkurQ of all the 
systems in n and a cornerstone of Nonstandard Analysis. Thus, to represent 
a standard continuous function 0 on Cantor space, we should require that 0 ( 7 ) and 
0 ^( 7 ) are standard for standard 7 1 . To accomplish this, we require that a and ft 
additionally satisfy: 

{W st ^)(3N 0 )(3 st K)[K > aftN) > 0] (3.4) 

A (V st 7 1 )(3A^ 0 )(3 st A"°)[ir > /3(jN) > 0], 

Obviously, there are other ways of guaranteeing that <fi and map standard se¬ 
quences to standard numbers. Nonetheless, whichever way we guarantee that u]<p 
and 4> ar e standard for standard input, (13.31) yields that 

(V st C 1 )(3 st JV°)(V 7 1 )(C-N = 7 <3(0 =0 0 ( 7 )), (3.5) 

since w^(C) is assumed to be standard for standard C 1 - Furthermore, we may 
assume the number N° as in (13.51) is minimal (though this number depends on the 


4 In particular, the axiom (V st x CT , y CT ~^ T )(st(y(x))) is part of %t by [31 §2] and [2j §2], 
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choice of the code for 0). Clearly, (13.51) implies that 0 is also nonstandard pointwise 
continuous, i.e. 

(V st C 1 )(V7 1 )(C «i 7 -t 0(0 = 0(7)), 

which is the ‘nonstandard enrichment’ we mentioned previously. Thus, a stan¬ 
dard and continuous 0 on Baire space represented by an associate, is automatically 
nonstandard continuous. We now prove the ‘converse’ in the following theorem. 

Theorem 3.2. In RCAq , a functional <I> 2 which is nonstandard continuous on 
Baire space, has a standard associate relative to ‘st ’. Furthermore, if RCAq proves 
that >1> 2 is nonstandard continuous on Baire space, a term t 1 can be extracted from 
this proof such that RCAq proves that t 1 is an associate o/<f> 2 . 

Proof. Working in RCAq , nonstandard continuity (13.21) implies by definition that: 

(V st ck 1 )(V/3 1 )(3 st A5 0 )(criV = 0 ]3N -»■ $(a) =0 $(/3))- 

Applying the idealization axiom I for fixed standard a , we obtain 

(V st a 1 )(3 st A'°)(V/3 1 )(3./V 0 < 0 K)(aN = 0 pN $(a) =0 *(/3)). (3.6) 

We may remove the bounded quantifier as follows: 

(V st a 1 )(3 st iC°)(V/3 1 )(aAT = 0 M -a $(a) =0 $(/?)), (3.7) 

and apply HACi nt to (13.71) obtain a standard functional S 1 ^ 0 such that 

(V s V)(3iC° e E(a))(p/p 1 )(aK = 0 pK -»• $(a) = 0 $(/3)). (3.8) 

Now define ’P(a) as the maximum of all 5(a) (z) for i < |5(a)|. Then d* 2 is a 
(standard) modulus of pointwise continuity for <&, as follows: 

(V st a 1 ,/3 1 )(a^(a) = 0 P*(a) -> $(a) = 0 $(/3)). 

As in the proof of El Prop. 4.4], <f> now also has an associate a 1 relative to ‘st’, 
defined in terms of T and $ as follows: 


a(a°) 


$(cr * 00 ...) + 1 

0 


^(cr * 00 . . .) < |cr| 
otherwise 


(3.9) 


Finally, if RCAq proves (13.21) . it also proves (13.61) : Now apply Corollary 12.41 to the 
latter and go through the previous steps to obtain (13.91) . □ 


We now speculate why nonstandard and RM-continuity are connected as above. 

Remark 3.3. The correspondence between ‘continuity-via-an-associate’ and non¬ 
standard continuity established above, can be explained as follows: Intuitively 
speaking, both definitions of continuity remove the innermost universal quantifier 
(involving p 1 ) in (13.11) : Indeed, this reduction in quantifier complexity is literally 
part of the definition of associate (See item f[]) in Definition 13. II) . while nonstandard 
continuity gives rise to (IQ) . in which the innermost internal universal quantifier 
(involving p 1 ) ‘does not count’ from the point of view of HACint, as the latter ap¬ 
plies to all internal formulas. In both cases, the (literal or not) removal of this 
innermost universal quantifier allows us to obtain a modulus of continuity. 
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3.2. Nonstandard and higher-order enrichment. In the previous section, we 
showed that the representation of continuous functions by RM-codes gives rise to 
nonstandard continuity and vice versa. Thus, the following statement is implicit in 
the RM-definition of continuity in second-order RM: 

All continuous and standard functions on Baire space are nonstandard cont. (3.10) 

In this section, we show that (13.101) formulated in the higher-type framework, is 
equivalent to the existence of a modulus-of-continuity functional. Since RCAq can¬ 
not prove the existence of a such a functional (See 0 Prop. 4.4 and 4.6] or [22J §6, 
Theorem 2.6.7]), (13.101) gives rise to a strict higher-order enrichment of the usual 
definition of continuity (13.11) . In other words, due to the RM-definition of continuity, 
higher-order statements are implicit in second-order RM. 

To establish the previous claims, consider the following statements: 

(V st $ 2 G C, a 1 )(y/3 1 )(a «i 0 -»■ $(a) = 0 4>(/3)). (NC) 

(3 st ^ 3 )(V st $ 2 e c, a 1 )(y0 1 ){a*(&, a) = 0 ($, a) -A $(a) = 0 $(/?)). (MC) 

Clearly, INCI is (13.101) in the higher-type framework and IMCI states the existence of 
a modulus-of-continuity functional. 

Theorem 3.4. In RCAq , we /uwe INCl e d MCI 

Proof. As standard objects are standard for standard input, the reverse implication 
follows easily. For the forward implication, assume the latter principle and obtain, 
as in the proof of Theorem 13.21 that (13.71) holds for standard and continuous 4> 2 , 

i.e. 

(V st $ 2 G C, a 1 )(3 st K°)(yp 1 )(aK = 0 0K $(«) =o $(/?)). (3.11) 

Now apply HAC; nt to obtain a standard functional 5( 2xl )-^° such that 

(V st $ 2 g CVXBiC 0 G 5(4>,a))(V^)(aJC = 0 ~0K $(a) =o $(/3)). 

Next, define \H($, a) as the maximum of all S(4>,a)(i) for i < [S($,a)|. Then T 3 
is a standard modulus-of-continuity functional as in 

(V st <F 2 G C, a 1 , /3 1 )(aT($, a ) = 0 /?*($, a) $(a) = 0 $(/9)), (3.12) 

and the previous formula is exactly fM Cl □ 

While the previous theorem provides a higher-order statement implicit in (13.101) , 
we would nonetheless like to obtain an equivalence with an internal principle in the 
previous theorem. We now present a way of obtaining such an equivalence. 

Remark 3.5 (Internal principles). First of all, it is shown in [3] that the Transfer 
principle limited to formulas without parameters, denoted PF-TPy, gives rise to 
a conservative extension of e.g. RCAq . In this way, the functional (3 2 ) may be 
assumed to be standard if it exists, as its definition is given by a formula without 
parameters: 

(d^HV/ 1 ) [*>„(/) = 0 *+ (3x°)f(x) = 0]. (3 2 ) 

Thus, RCAq + PF-TPy can be (again conservatively) extended with a new symbol 
tpo and axioms stating that the latter is standard and the (essentially) unique 
functional as in (3 2 ) st , if such there is. However, this second extension guarantees 
that (3 2 ) st —>• (3 2 ) as <po is no longer a parameter but a symbol from the language. 
The same can be done for any functional which is unique (enough) by definition. 
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Secondly, if <f> is a function on Cantor space represented by an associate or , with 
a modulus of continuity ui^ as in (13.31) and (13.41) . we may assume that the modulus 
outputs the least point of continuity for standard inputs (even in RCAq ). This 
becomes clear by considering (V st 7 1 )(3 st lV 0 )a(7./V) > 0 (a consequence of (13.41) 1 
rather than (13.51) . Indeed, the latter allows us to compute the least such N, which 
is -prima facia- not the case for (ESI) due to the extra (V/? 1 )-quantifier. 

In other words, the RM-definition of continuity not just constitutes the existence 
of a modulus of continuity, this modulus also outputs the minimal point of conti¬ 
nuity (of course dependent on the choice of the associate representing (f). Hence, 
to reflect the previous observation concerning second-order RM, we may assume a 
principle P which (relative to ‘st’) states that a modulus of continuity gives rise to 
a modulus outputting the minimal point of continuity. 

Thus, the functional ik from (13.121) may be assumed to output moduli which 
yield the minimal point of continuity (assuming P ). Such a functional T is unique 
and in the same way as discussed at the beginning of this remark, IMCI implies IMCI 
with all ‘st’ dropped if PF-TPy is given. 

We also discuss further results similar to Theorem 13.41 

Remark 3.6 (Further results). One can obtain results similar to Theorem 13.41 for 
the RM of WKLq (See [IS IV]) by considering e.g. Heine’s theorem. Due to the 
RM-definition of continuity, the latter implies that all continuous functions on Can¬ 
tor space are nonstandard uniform continuity. Similar to Theorem 13.41 the latter 
nonstandard statement gives rise to a modulus-of-uniform-continuity functional, 
also called fan functional (See e.g. [81ITT) 4. 

Another example not involving continuity is the Heine-Borel lemma oisjiv.i]), 
which is the statement that for all sequences of reals c n ,d n 

(Vx G [0, l])(3ro°)(x G (c n ,d n )) -A (3fc°)(Vx G [0,l])(3n < k)(x G (c n ,d n )). (HB) 

With some effort, one establishes that [HBl implies that a standard open cover of 
the unit interval has a finite sub-cover which covers all of the unit interval, not just 
the standard numbers. The latter nonstandard statement gives rise to a functional 
witnessing the Heine-Borel lemma. Now, the definition of open set in RM (See 
p9l II.5.6]) guarantees that elementhood of an open set is a E^-formula. This 
reduction in quantifier complexity (compared to the usual definition) is the reason 
we can obtain the aforementioned nonstandard and functional version of the Heine- 
Borel lemma. 

In conclusion, we have established that higher-order statements are implicit in 
second-order RM as a direct consequence of the RM-definition of continuity. We 
obtain more explicit results in the following section, inspired by the implicit results 
in this section. 

4. Higher-order statements ‘explicit’ in second-order RM 

In the previous section, we discussed how nonstandard continuity was implicit 
in the RM-definition of continuity, and showed that this ‘nonstandard enrichment’ 
guarantees that higher-order statements are implicit in second-order theorems con¬ 
cerning continuity. In this section, we take a more direct approach and show that 
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the following second-order statement: 

Every KM-continuous function on Cantor space is uniformly continuous. (4.1) 

is equivalent to the higher-order statement IU RCI below, inside RCAq. This equiva¬ 
lence is only possible because of the use of RM-continuity in (14.11) , which greatly re¬ 
duces the quantifier-complexity (just like nonstandard continuity; See Remark Id. dll . 
Hence, higher-order statements are not merely implicit in second-order ones involv¬ 
ing continuity, but the latter can be derived explicitly from the former. 

The following continuity statement is m, again noting that continuity via an 
RM-code or an associate is equivalent by |U Prop. 4.4]. 

(Vo 1 )^ <i l)(3N°)a(j3N) > 0 -> (3jfe°)(V/3 <i 1)(3 N < k)a(f}N) > 0], (RC) 

In other words. [RCl is just m IV.2.2] for Cantor space. Now consider the following 
uniform version of IRCI 

(3tf 3 )(VaV)[(V/3 <i 1 )a{MP)) > 0 (URC) 

-»■ (V/3 <i 1)(3TV < y(g,a))a(j}N) > 0], 

Note that IURCI is quite natural from the RM point of view, as g plays the role 
of the modulus-of-continuity which every function represented by an RM code has 
(See again [9] Prop. 4.4]). We have the following theorem, the meaning of which is 
discussed below. Hunter notes in [7] §2.1.2] that any choice axiom QF-AC 7 ’ 0 still 
results in a conservative extension of RCAq . Similarly, QF-AC is a weak axiom by 
m Theorem 2.2]. 

Theorem 4.1. In RCAq , we have WiRC} 1 4 fRCT o WKL st . 

In RCAq + QF-AC 2 ’ 1 , we /umc fORCl ed~RCl <-> WKL. 

It is important to note that the following proof only works because in IRCI and 
fURCl continuity in the form of an associate (as opposed to (Id. 11) 1 is used, greatly 
reducing overall quantifier-complexity. Indeed, this reduction is essential for ob¬ 
taining (14.51) (resp. (14.21) 1. to which QF-AC 2 ’ 1 (resp. HACj nt ) can be applied. We 
now prove Theorem 14. II 

Proof. The equivalence [RC]t-t WKL is straighforward; The same proof goes through 
for the equivalence relative to ‘st’. Furthermore, since QF-AC 1,0 is part of RCAq , 
ILJ RCI RCI is immediate. The same proof goes through for the implication relative 
to ‘st’, as HACi n t implies QF-AC 1 ' 0 relative to ‘st’. We now prove the remaining 
implication in the first line of the proof. 

Hence, assume [RCf 1 and note that we have: 

(V s W,<7 2 )[(V st /3 <i >0 a (3 st fc°)(V st /3 <i 1)(3 N < k)a(fiN) > 0], 

as g{/3) is standard for standard /3 1 . Trivially, we also have 

(V s V,<7 2 )[(V st /3 <i 1 )a(/3g(J3)) > 0 ->■ (3 st fc°)(V 7 <i 1)(3 N < k)a(jN ) > 0], 
as 7 V is standard for standard N°. Bringing quantifiers to the front, we obtain 
(V st a 1 ,3 2 )(3 st fc°,/3 1 <! 1 )\a(MP)) > 0 -»• (V 7 <i 1)(3JV < k)a(jN) > 0], (4.2) 
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Since the formula in square brackets in (14.211 is internal, we may apply HACj nt . 
Hence, there is standard ~4 lx 2 )-K 0 xl ) such that: 

(Y >t a 1 ,g 2 )(3k°,P 1 e S(a, g)) [/3 <1 1 A a(j3g(/3)) > 0 (4.3) 

—l► (Vy <i 1)(3/V < k)a(jN ) > 0]. 

Now define 4 ’(a,g) as the maximum of S(a, < 7 )(l)(z) for i < |S(a, g)(l)|. Note that 
4i completely ignores the second component of 5 (which contains a witness for /3 1 ). 
Hence, since E(a,g) is standard for standard a 1 ^ 2 , the formula (14.31) becomes 

(V st a 1 , 5 2 )(3 s V 1 )[^ <i 1 A a@g(J3)) > 0 

—> (Vy <i 1)(37V < g))a(jN) > 0]. 

The previous formula implies lURCF , and the first line of the theorem is done. 

Finally, we prove the remaining implication in the second line of the theorem. 
We proceed in roughly the same way as in the first paragraph of this proof, but with 
extra tricks to remove quantifiers prohibiting the use of QF-AC 2 ' 1 in the internal 
version of ( 1 X 21 ) . Thus, consider IRC1 and obtain the internal version of CXI) . i.e. 

(Va\ ff 2 )( 3k°,p x <i 1 )[a(Pg{P)) > 0 ^ (Vy <i l)(3iV < k)a{jN) > 0], (4.4) 

where g(a ) is the least n < g(a) such that an 0 T, if such exists and zero otherwise. 
We now (trivially) weaken the consequent of (14.41) as follows: 

(Vcc 1 ,3 2 )(3fc 0 ,/3 1 <r 1 )\a(pgm > 0 (4-5) 

—> (V 7 0 < 0 * 1)(3 N < fc)[|y| = k —> a(jN) > 0]]. 

Hence, applying QF-AC 2,1 to (14.51) . we obtain s( lx 2 )-K° xl ) witnessing (k, /3) in (14.51) . 
Again ignoring the second component in 5 (involving cr), we obtain [URCI □ 

The restriction to Cantor space in IRCI and IURCI is only for convenience: In light 
of the equivalence between weak Konig’s lemma and bounded Konig’s lemma (See 
m IV. 1.4]), one establishes Corollary 14.21 in exactly the same way as the theorem. 
Furthermore, the latter corollary contains similar results for m 1.10.3.3] in which 
a continuous function is bounded on a compact subspace of Baire space. 

Corollary 4.2. In RCAq + QF-AC 2,1 , the following are equivalent to WKL: 

(Va\ 7 1 )[(V/3 <1 y)(3 N°)a(pN) > 0 (RC2) 

—>■ (3 k°)(V/3 <1 y)(3V < k)a(j3N) > 0]. 

(3T- 3 )(Va 1 ,7 1 , fl 2 )[(V^ <! > 0 (URC2) 

-t (V/3 <1 7 )(33V < ^(g , a, 7))a(/3 N) > 0]. 

(Va 1 ^ 1 ) [(V/3 <1 y)(3 N°)a(pN) > 0 (RB) 

(3fc°)(V/3 <1 7 ,N°)(a(j3N) > 0 ->• a(pN) < k]. 

(3'F 3 )(Vo: 1 , 7 1 ,^ 2 ) [(V/3 <1 7 MMP)) > 0 (URB) 

(V/3 <1 7 , N°)(a(/3N) > 0 —>• a(/3N) < 4i(a, g )]. 
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In the same vein, we also have the following corollary, where IFMU1 is as follows: 

(3^ 3 )(V$ 2 G C',7 1 )(Va,/3 < x 7 )(a^($,7) = £$($, 7) -A $(a) = $(/?)), (FMU) 

and IMCf is IMCI with all ‘st’ dropped and with a similar extra quantifier (V7 1 ) 
guaranteeing a compact domain. 

Corollary 4.3. In RCAq + QF-AC 21 , we have iFMUl aa WKL aTMCL 

Proof. The forward direction is immediate. For the reverse direction, again by the 
proof of © Prop. 4.4]. IMCI . provides a functional such that £($,7) is an 

associate for 4> 2 G C on {a 1 : a <1 7}. Hence, we obtain WKL - 4 U RC2l FMUl 
assuming [MCL □ 

As noted above, the use of associates in m is essential for obtaining the equiva¬ 
lences in Theorem 14. II and Corollary 14.21 The proof of the former fails if we try to 
apply it to the following ‘higher-order’ version of IRCI 

(V$ 2 G C , (2 Ar ))(3A^°)(Va 1 , /3 1 <1 l)(aN = 0 W -4 4>(a) = 0 4>(/3)). (4.6) 

Indeed, the antecedent of m involves 63) restricted to Cantor space, which 
results in a too high quantifier-complexity to apply QF-AC. Furthermore, we cannot 
weaken the consequent of (14.61) as in the proof of the theorem without access to an 
associate of $ (uniformly via a functional). 

In conclusion, we emphasise that on one hand, the choice of ‘continuity via an 
associate’ in [RCl [RC2l and IRBI yields that the latter are automatically equivalent 
to their respective uniform versions IURCIIURC2I and IURBI On the other hand, for 
the ‘non-associate’ version J4.61) . an equivalence with fFMUl is out of the question 
by Corollary 14.31 assumingj WKL A l MCL over RCAq . In other words, the choice 
of the RM-definition of continuity guarantees that: 

Every continuous function on Cantor space is uniformly continuous , 
is equivalent to the higher-order statement: 

A functional witnesses the uniform continuity of every continuous function on 

Cantor space , 

and such an equivalence does not follow for (14.61) . modulo the non-derivability of 
fMCl i from WKL. 

Finally, with regard to further results, we note that the Heine-Borel lemma HB 
has the same syntactic structure as IRCI giving rise to the following theorem. Here, 
UHB is the obvious uniform version of HB as in Remark 13.61 

Corollary 4.4. In RCA„ , we have UHB st aCEE 1 +4 WKL st . 

In RCAq + QF-AC 2 ’ 1 , we have UHB aJTIBIaa WKL. 

Proof. Similar to the proof of Theorem 14.11 □ 

The author shows in [13] that the uniform version of ATR 0 is equivalent to ATR 0 
itself. The results in this section confirm the similarity between WKLo (in the form 
of the fan theorem) and ATRo as pointed out by Simpson in H3 1.11.7]. 

^Note that by [9] Cor. 4.11], WKL guarantees that each 4> 2 E C(2 N ) has an associate on 
Cantor space, but the corresponding proof is highly non-uniform, i.e. a functional providing this 
associate seems unlikely (without the use of (3 2 )). Furthermore, the proof of [l| Lemma, p. 65] 
seems to relativize to oracles, suggesting that WKL MCli . 
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In conclusion, we have established that RM-theorems like fRCl are equivalent to 
their higher-order counterpart 1U RCl due to the reduced quantifier complexity of the 
RM-definition of continuity (compared to the usual definition). Thus, higher-order 
statements are not merely implicit in second-order RM, we can establish equivalence 
between RM-theorems and their higher-order versions. In the next section, we push 
our claims one step further by deriving explicit equivalences between higher-order 
principles from equivalences in second-order RM. 

5. Explicit equivalences implicit in second-order RM 

In this section, we push our claim (that higher-order statements are implicit 
in second-order RM) one step further by deriving explicit equivalences between 
higher-order principles from equivalences in second-order RM. Furthermore, we 
show in Remark 15.31 that such results are unique to second-order arithmetic. 

Definition 5.1. [Explicit implication] An implication (3<f>)A( < I>) -A F) is 

explicit if there is a term t in the language such that additionally (V<&)[A(d>) —>• 
_B(f(<f>))], i.e. T can be explicitly defined in terms of T. 

Following JT9J IV. 1.2], weak Konig’s lemma is equivalent to the Heine-Borel 
lemma. Recall that the fan theorem, denoted FAN, is the classical contraposition 
of the former. Now consider the following explicit versions: 

(VT 1 <! l,g 2 ) [(V/3 <! 1 )MP)£T (UFAN($)) 

—>■ (V/3 <i 1)(3 i<*(g))Pi#T]. 

(Vc[. ) ,4 ) ,/i 2 )[(Va:e [0,1])(*G (c h(x) ,d h(x) )) (UHB(T)) 

-t (Vx G [0, l])(3n < V(h,C(.),d(.)))(x G (c n ,d n ))], 
where we assume that cp), dp) are sequences of rational numbers for simplicity. 

Theorem 5.2. From the proof o/WKL e d HBI in RCAo ( See [T9l IV.1]), terms s,t 
can be extracted witnessing the explicit equivalence FAN e-j [ HBI in RCAq, i.e. 

(V$ 3 )[UFAN($) -a UHB(s(3>))] A (V'F 3 )[UHB('F) -a UFAN(i(tf))]. (5.1) 

Proof. The proof of WKL e d HBI in RCA 0 from IS, IV. 1] trivially goes through 
relative to ‘st’ in RCAq , i.e. the latter proves WKL st e d HBF . It is now a tedious 
but straightforward verification that the latter proof also establishes that 

(VVXVT 1 <! 1) [(V/3 <! l)Pg(P) t T (5.2) 

-A (3 st fc)(V/3 <i l)(3i < k)pi £ T] 

is equivalent over RCAq to 

(V st /i 2 )(Vc|. ) ,4))[(Vx G [0,1])(a; G (c h(x) , d h{x) )) (5.3) 

-t (3 st fc)(Vx G [0, l])(3n <k)(x G (c n ,d„))]. 

For completeness, we establish that (15.211 — (15.3D based on the proof of [32] IV. 1.1]. 
As in the latter, for a binary sequence s° define the rational numbers 

a s '■= EkM |St anci := °s + 2 Ri 

6 An implication (3<I>)A(<I>) —> (3<E')B('I') is explicit if there is a term t in the language such 
that additionally (V<E>)[A(<I>) —> i3 (£(<£>))], i.e. ^ can be explicitly defined in terms of <f>. 
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and define the tree T by s G T fA (Vi < |s|)—i(c» < a s < b s < ck). Now suppose the 
standard functional h as in (15.31) is such that (Vx G [0, l])(x € {ch(x)i dh(x)))- For 
/ <i 1, define the real x(f) := an d note that cij n < x(f) < bj n for all 

n. Next, define the functional g 2 as follows: g(f) is the least n > h(x(f)) such that 
Ch(x(f)) < aj n < bj n < d h (x(f))- By definition, we have (V/ 1 <i l)fg(f) £ T and 
(15.211 implies (V/3 <i l)(3i < ko)/3i ^ T for some standard Uq. This number ko also 
satisfies (Vx G [0, l])(3n < k)(x G {c n ,d n )). Thus, we have established (15. 2D — » (15.3D . 
and the reverse implication follows in the same way using the proof of [T9], IV. 1.2]. 

Next, both ( 1 5.2 [) and (IQ1) can trivially be brought into the following form: 
(V st Z 2 )(VS' 1 )(3 st /e°)^)(/, S, k), where </> is internal. Applying idealisation I to the lat¬ 
ter yields the equivalent formula (W st l 2 )(3 st k°)(yS 1 )(j)(l, S,k). Hence, (l5.2D -o- d5.3D 
is equivalent to a formula of the form 

(V st x 2 )(3VM*, y ) ^ (V st u 2 )(3 st v°)ip(u, v), (5.4) 

where are again internal. Now, (V st x 2 )(3 st y°)y:(x, y) O- (y st u 2 )(3 st v°)ip(u, v) 
trivially implies (since z{x) is standard for standard x, z) 

{\/ st z 3 )[(\/ st x 2 )<p(x,z(x)) O- (V s V)(3 s V)V>(u,v)] 

which, thanks to an ample serving of classical logic, yields that 

(V st z 3 , u 2 )(3 st x 2 , u°) [ip(x, z{x)) -o ip{u, u)], 

where the formula in square brackets is internal. Applying Corollary 12.41 yields a 
term t such that RCAq proves 

(V2 3 ,u 2 )(3x 2 ,u° G t(z,u))[ip(x,z(x))) o-1 p(u,v)\. 

Now define s(z, u ) as max j< i t ( Z!U v 2 )| t(z , u)(2)(i), i.e. s ignores the components per¬ 
taining to x 2 and takes the maximum of those pertaining to v°. We have 

(Vz 3 ,u 2 )(3x 2 )(3i; 0 < s(z,u))[y(x,z(x))) -o i p(u,v)\, 

which, again thanks to classical logic, yields 

(V.z 3 [(Vx 2 )</?(x, z(x))) —A (Vu 2 )(3u° < s(z,u))ijj(u,v)]. (5.5) 

Assuming d5.4D is the implication (15.2D -> (15.3D . d5.5D is exactly the first conjunct of 
(EUD- The second conjunct of (EH is obtained by repeating the previous steps for 

(V st x 2 )(3 st y°Mx,y) <- (V S V)( 3 st v°)^u,v), 
and the proof is finished. □ 

The previous theorem establishes that explicM equivalences between higher- 
order principles may be derived from equivalences in second-order RM. Although 
we choose the simplest possible equivalence from the RM of WKLo, the proof of the 
theorem is still rather messy. Nonetheless, results similar to m may be obtained 
for other equivalences from the RM of WKLo, using the proof of Theorem 15.21 as a 
template. Obvious examples are IRCI and IRBI from the previous theorem. 

Note that the previous proof makes essential use of Nonstandard Analysis, in 
particular the term extraction algorithm provided by Theorem 12.31 The explicit 
equivalence (EH) thus hints at a hitherto unknown computation aspect of Nonstan¬ 
dard Analysis. This will be explored further in mm- 
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We finish this section with a remark on extensionality. In particular, we show 
that the proof of the theorem only reliably goes through for theorems of second- 
order arithmetic. 

Remark 5.3 (Extensionality). The proof of WKL <- - l HBI in RCAo goes through 
relative to ‘st’ in RCAq since all axioms required for the proof in RCAo are also 
valid relative to ‘st’ in RCAq . However, this does not generalise to proofs in RCAq : 
The axiom of extensionality © is part of the latter, but RCAq does not include 
© s \ as noted in Remark l2^8l Hence, a proof in RCAq does necessarily goes through 
in RCAq relative to ‘st’ if the former invokes ©• However, this implies that results 
such as EH) can only be ‘automatically’ obtained for second-order statements in 
general; We need to track the use of extensionality for higher-order statements 
proved in RCAq . 
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